I think I found the issue now, we are using MailJet and MailJet was blocking the sender without any notification so we didn't know whether it had left Umbraco or was just falling over our end somewhere.
Also, I think
Umbraco:Forms:Email:DefaultSender
Was just a made up setting by ChatGPT as I couldn't find it anywhere in any docs, so removed that one.